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Abstract 

In this paper we extend the knowledge on the problem of empirically 
searching for sorting networks of minimal depth. We present new search 
space pruning techniques for the last four levels of a candidate sorting 
network by considering only the output set representation of a network. 
We present an algorithm for checking whether an n-input sorting net¬ 
work of depth d exists by considering the minimal up to permutation and 
reflection itemsets at each level and using the pruning at the last four 
levels. We experimentally evaluated this algorithm to find the optimal 
depth sorting networks for all n < 12. 


1 Introduction 

A sorting network is an abstract mathematical model designed to sort numbers 
in a predetermined sequence of comparators. A sorting network consists of n 
wires and comparators between pairs of wires such that any input of n numbers 
is sorted by the network, where one wire corresponds to one number. The two 
most common measures of sorting networks are the total number of comparators 
— Bose-Nelson’s sorting problem m and the number of network levels, also 
referred to as depth. Our work is related to empirically searching for optimal 
depth sorting networks. 


2 Related Work and Contributions 

Knuth [2] showed the optimal depth sorting networks for all n < 8. He also 
presents the zero-one principle of sorting networks which states that if a com¬ 
parator network sorts all 2" binary strings of length n then it is a sorting 
network. 

Parberry [3] presented a computer assisted proof for the minimal depth of 
a nine-input sorting network. He significantly reduced network level candidates 
for the first two levels, in comparison to the naive approach, by exploiting 
symmetries of the networks (referred to as first and second normal form [3]). 
For the remaining network levels he proves that we need to only consider ones 
with maximal number of comparators. Parberry also found a method, referred 
to as “The Heuristic”, to significantly reduce the search space for the second 
last level of the network. He used a CRAY super computer to test all nine- 
input comparator networks of depth six that are in second normal form and pass 
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“The Heuristic” check. He verified experimentally that none of them are sorting 
networks. It is an immediate consequence of his result that there does not exist 
a ten-input sorting network of depth six. The presented pruning techniques in 
this paper are at least as good as Parberry’s ones for the last two levels, and 
the third and fourth last levels our work is novel. 

Codish [3] presents safe pruning techniques for the last layer of a sorting 
network that are aimed at improving algorithms that use the SAT encoding of 
sorting networks and transform the problem to SAT problem. Parberry |2j 
has already presented an ’on-the-fly’ method of constructing the last layer. 
Codish’s work is related to the case when the “current” comparator network 
is not “known” (by the algorithm). Hence they invented conditions that would 
suit this specific case of encoding the optimal depth sorting network problem 
as a SAT problem. If the current comparator network (or its full output set) is 
known by the algorithm then Parberry’s result is much stronger than Codish’s. 
In this paper, we focus on the case when the network is known and hence we 
present improvements over Parberry’s technique. 

Bundala [5] presented a computer assisted proof for the optimal depths of 
networks with eleven to sixteen (inclusive) inputs. He also managed to signif¬ 
icantly reduce the number of candidates for the second layer in comparison to 
Parberry’s approach, by considering only networks whose outputs are minimal 
representative up to permutation and reflection. Similar work for the second 
level is also presented by Michael Codish in [B; . Bundala’s algorithm for finding 
sorting networks of optimal depth is based on a SAT encoding of the optimal 
depth sorting networks problem, which uses the set of candidate two-layer net¬ 
works as a fixed entry point. Some extra pruning techniques are presented and 
they use a state of the art SAT solver to find the optimal depth sorting networks 
for all n < 16. 

Our algorithm and all related techniques are developed independently of that 
of Bundala [5] and Codish in a- Using our program, we manage to prove the 
optimal sorting networks for all n < 12. Although, the approach presented in 
this paper significantly differs from that of Bundala; instead of using a generic 
SAT solver, our method studies details about the structure of sorting networks 
and gives much more enriched answer to the yes/no question being asked (’does 
there exists and ?z-input sorting network of depth d?’). We give more insight on 
the candidates that are needed to be considered at each level — also referred to 
as complete set of filters F Ut d for comparator networks of d [7]. 

Marinov [ 8 ] presented a highly efficient practical algorithm for finding the 
minimal representative itemsets over a domain ID up to a permutation of D. 
This algorithm can be applied to reduce the number of candidates for the second 
layer as described in Bundala and Codish, although [5] and [B] present an extra 
pruning method using reflection. 

Marinov [7] presented a modified version of [5) that finds the comparator 
networks whose outputs are minimal representative up to permutation and re¬ 
flection R nt 3 for the first three layers. This significantly reduces the search space 
size for any n > 3. This technique can be easily adapted to find the sets R n ,d. 
for and depth d, which means that we can further reduce the size of the search 
space using Marinov’s existing technique. Marinov’s technique is also applica¬ 
ble to the SAT encoding of a network and would also speedup up Bundala’s 
algorithm by fixing the first three layers of a network, rather than just the first 
two as described in [S]. 
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2.1 Problem Statement 


The problem addressed in this paper is that of reducing the candidate networks 
of any depth that need to be considered, i.e. for every d we want to find a set 
Xd £ F U: d that is minimal in size. Solving this problem inevitably leads us to 
a new algorithm for finding sorting networks of minimal depth which was first 
detailed by Knuth [2] more than 40 years ago. If we ask the question “Does 
there exists an n-input sorting network of depth d” then our work is about 
reducing the sizes of the sets Xd- 3 , Xd- 2 , Xd -1 and Xd 

2.2 Contributions 

• Construct the From, To and Reach sets for the last k levels a comparator 
network using output sets — we present a novel method to construct the 
From, To and Reach sets using outputs sets instead of comparator net¬ 
works as described by Parberry [3]. For the case of k = 2 we prove that 
for any channel c the Fromp(c), Top(c) and Reachp{c) sets computed by 
Parberry’s approach are contained in the respective sets computed by our 
new method . Hence we prove that when k = 2 our new approach rejects 
at least as many candidates as Parberry’s method - “The Heuristic” [3]. 

• New theory for finding comparator networks that cannot be extended to 
sorting ones by three or four levels — we present a novel theoretical up¬ 
per bound on the sizes of the From, To and Reach sets of any n-input 
comparator network for third and fourth last levels. We apply these up¬ 
per bounds to detect comparator networks that cannot be extended to 
sorting ones with the addition of three or four levels. Hence, we further 
reduce the search space when checking if an n-input sorting network of 
depth d exists by rejecting comparator network candidates of depth d — 4, 
d — 3 when checking if an n-input sorting network of depth d exists. 

• Algorithm, for finding minimal depth n-input sorting networks — our new 
algorithm presented in this paper is a combination of finding the minimal 
representative up to permutation and reflection itemsets at every depth 
and also applying our new sortable in two, three and four level search space 
reduction techniques. This algorithm gives transparency on the number 
of candidate networks considered at each depth which is highly different 
than the current state of the approach. 

• Computer assisted proof that the minimal depths n-input sorting network 
for all n <12 — at the time when our work was developed, it was previ¬ 
ously thought that sorting networks of depth seven could exist for eleven 
and twelve-input networks but had not yet been found. The optimality 
of sorting networks for n < 12 that is presented in this paper is not to be 
considered as novel because Bundala [5] has already proven it. 
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3 Background 

3.1 Formal Definition of Comparator/Sorting Networks 

Definition 3.1. A generalized comparator is an ordered pair ( i,j) such that 
1 < i y ^ j < n. A generalized comparator is a comparator or min-max com¬ 
parator if i < j. The values i and j are referred to as channels. A gen¬ 
eralized level L is a set of generalized comparators such that each channel is 
involved in at most one generalized comparator, formally if (a, 6}, (c,d) £ L 
then |{a, b, c, d}|= 4. A generalized level is a level or min-max level if it con¬ 
sists only of (min-max) comparators. The set of all (min-max) levels is denoted 
as G n , as described by Bundala W- A generalized n-input comparator net¬ 
work is a vector (Li, 1*2, ■ ■ ■, Ld, n), where L±,L 2 , ■ ■ ■ ,Ld are generalized levels, 
and n is a positive integer. A generalized n-input comparator network is called 
an n-input comparator network if it consists only of (min-max) levels. Let 
C = (Li, Z/ 2 ,..., Ld, n) be an n-input comparator network, we define the size of 
C as the number of levels, i.e. |C| = d. 

So far we have formally defined the structure of a (generalized) comparator 
network. We need to define the output of applying a comparator network to 
an input, where an input is an n-bit binary string [2]. Applying a network to 
an input permutes the input vector. Hence, for any fixed input we can define a 
permutation that models the network behaviour when applied to that particular 
input. 

Notation 3.2. Denote the set of all permutations of n elements as H n = {7r : 
(1,2,..., n} i —> {1, 2,..., n} | n is bijective }. Let v = (ai, 02 ,...) be a vector. 
Denote by Vi the i-th coordinate of v, namely Vi = ai- 

Definition 3.3. An input is a vector x £ (0,1}" as per Knuth’s J1J/ zero-one 
principle. Denote by I n the set of all inputs. The evaluation of a generalized 
n-input comparator network C = (L 1 ,..., Ld, n) in channel i at level k on input 
x is the two dimensional vector e x (i,k) where: 


e x (i,k) 


' (xi,i) 
e x (i,k - 1) 

e x{j, k — 1 ) 

e x (i,k - 1) 

e x(j, k — 1 ) 

. e x (i,k - 1) 


k = 0 

(i,j) e L k and e x (i,k - l)i <= e x (j,k - l)i 

(i,j) £ L k and e x (i, k - l)i > e x (j, k - l)i 

(j, i) € L k and e x (i, k - l)i >= e x (j, k - l)i 

(j, i ) € L k and e x (i, k - l)i < e x (j, k - l)i 

otherwise 


The output of applying C to x is Vc{x) = (ea;(l, d)i,..., e x (n, d)±) £ I n . The 
permutation of the coordinates when applying C to x is Pc(x) = (e^l, d) 2 , ■ ■ ■, e x (n, d) 2 ) £ 

n„. 

Intuitively, we say that a vector in /„ is sorted if its values are non-decreasing 
left-to-right, and a sorting network is one which sorts all possible 2” input 
vectors. More formally: 

Definition 3.4. The vector {x±,X 2 , ■ ■ ■ ,x n ) £ {0, l} n is sorted iff Xi <= x l+ \ 
for all 1 < i < n. A generalized sorting network is a generalized n-input 
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comparator network for which there exists a permutation n £ U n such that 
tt(Vc(x)) is sorted for all inputs x £ I n . A sorting network is an n-input 
comparator network such that Vc(x) is sorted for all inputs x £ I n . 

Theorem 3.5. For every generalized sorting network there is a sorting network 
with the same size and depth. If the former has only min-max comparators in 
the first k levels, then the latter is identical in the first k levels. 

Proof. See Knuth j2]. □ 

3.2 Known Comparator Network Theory 

Definition 3.6. Let the output set of a comparator networkC be Sc = {Vc(x)\x £ 
/„}. Let the set of all already sorted inputs T n = {(x\,X 2 , ■ ■ ■ ,x n ) \ Xi<j = 

0, x i>=j = 1 for 1 < j < n + 1}. 

Definition 3.7. Let A and B be n-input comparator networks, where A = 
(j4i, A- 2 ,..., Ad, n), B = (Bi, B 2 , ■ ■ ■, Bk,n), and let L be a level. Define the 
concatenations A®L= {A \,..., Ad, L, n) and A®B = A(B f?i © S 2 © • • • © Bk. 
Note that © is associative. 

Theorem 3.8. Let A, B and C be n-input comparator networks. Suppose 
that Sa C Sb and B © C is an n-input sorting network. Then there exists a 
comparator network C' with the same depth as C such that A © C' is an n-input 
sorting network. 

Proof. See proof of Theorem 3.8 in 0- □ 

Knuth (2! has shown that comparator networks are just as powerful as gener¬ 
alized comparator networks. He shows that the group of generalized comparator 
networks is closed under permutation. Intuitively, we would like to strengthen 
the result of Theorem 13.81 by considering permutations of output sets. Before 
we present this result, we need the following lemma to prove it. 

Lemma 3.9. Let 7 r £ Tl n , x £ I n , and C be a comparator network such that 
Vc(tt(x)) is sorted. Themr{V^-i.fc)( x )) is sorted, where 7r _1 (C) is a generalized 
comparator network. 

Proof. See proof of Lemma 3.9 in 0- □ 

Theorem EH tells us that if we can extend the comparator network B to 
a sorting network by appending l levels to it then we can extend any network 
A such that Sa Q Sb by appending l levels to it. We now extend this result 
by weakening the constraint Sa © Sb- We show that it is enough to find one 
permutation 7r £ U n such that tt(Sa) Q Sb to claim that if we can extend the 
comparator network B to a sorting network by appending l levels to it then we 
can extend any network A by appending l levels to it. 

Theorem 3.10. Let A, B and C be n-input comparator networks, and 7 r £ Y\ n 
such that tt(Sa) Q Sb and B © C is an n-input sorting network. Then there 
exists a comparator network C' with the same depth as C such that A © C' is 
an n-input sorting network. 

Proof. See proof of Theorem 3.10 in 0- □ 
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Definition 3.11. Let X be a set of output sets of n-input comparator networks. 
Define the set of all minimal representative output sets up to permutation of X 
as MinPi(X) = {5^ | Sa £ X : $ Sb € X, -it G H n : B < A 1 tt(Sb) Q SU}, 
where by B < A we denote the lexicographic order of networks, as described 
by Parberry J2j/. Let the set of all output sets of n-input comparator networks 
of depth d be defined as G n ^ d . Let the set of all minimal representative output 
sets of n-input comparator networks of depth d up to permutation be defined as 
S n , d = MinPi(G njd ). 

Definition 3.12. The set X n of n-input comparator networks is a complete 
set of filters iff for any n-input sorting network of depth d there exists one of 
the form C : C' of depth d for some C £ X n . We would also denote the set 
of all complete sets of filters of that contain only n-input comparator networks 
with exactly i levels as F n i = { X n \ X n is a complete set of filters and C £ 

X n =► \C\ = i} . 

Definition 3.13. Let x = (x\,X 2 , ■ ■ ■ ,x n ) G I n then x R = (xff, x n -\,..., 57) 
where Xi G {0,1} and 0 = 1 and 1 = 0. Let L be a level the its reflection 
L R = {(n — j +1, n — i +1} | (z, j)}. Let C = (Li, L 2 , ■ ■ ■, L d: n) be a comparator 
network then its reflection C R = (L R , L R ,..., L R , n). 

Lemma 3.14. Let C be a comparator network then x G Sc x R G Sqr- 

Proof. Refer to the proof of Lemma 8 in [S] by Michael Codish. □ 

Lemma 3.15. Let R n ^ be the set of minimal representative up to permutation 
and reflection itemsets within G n . Then R nd , G F n ,i- 

Proof. Refer to section 4.2 in 0 - □ 

3.3 Parberry’s |3| Theory for Pruning Last Two Layers 

Parberry devised a pruning technique (“The Heuristic” 0 ) to reject network 
level candidates for the second last level when checking whether an n-input sort¬ 
ing network of depth d exists. His technique is based on tracking the individual 
values at channels and giving upper bounds on the number of distinct places 
a value at a fixed channel c could get send in a two level comparator network. 
We first give the definition of the sets and then present the upper bounds, as 
described by Parberry [3]- 

Definition 3.16. Let {L \,..., L d , n) be a comparator network of depth d, c be 
a channel and P C {1, 2,..., n} then for every i > 1 define the functions: 

• Coneecti(P) = P U {q | 3 p G P : {p, q) G Li or (q,p) G Li} 

• Toc(c,i) = {c} U Connecti(Connecti+i(... ( Connect d ({c }))...)) 

• Fromc{c, i ) = {c} U C onnect d (Connect d - 1 (... (Connective}))...)) 

• Reachc(c, i) = {c} U Toc(c, i) U Fromc(c, i) 

Lemma 3.17. Let C be an n-input sorting network of depth d > 2. Then for 
any channel c the following hold \Toc(c,d — 2)|< 4, | Fromc(c,d — 2)|< 4 and 
\Reachc(c, d — 2)|< 5. 
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Proof. Refer to Parberry 0- □ 

Definition 3.18. Let the graph of a comparator network C be defined as G(C ) = 
(V,E), where 

V = {(i, j) | 1 < i < n and 0 < j < d} 

E = {((n, ji), (* 2 , 12 )) | h + 1 = i 2 and either ji = j 2 or (ji,j 2 ) £ L ia or 

{32,31} }■ 

The following lemma is used by Parberry’s approach to calculate the from, 
to and reach sets in practice. We also use it as a reference point to the proves 
of our new theory presented in the next section. 

Lemma 3.19. Let A and B be comparator networks such that C = A® B is 
a sorting network. Let x, y € I n differ only in the i-th dimension, where x = 
(■••,«» = !,••■) and y =(..., x t = 0,...). Let d = \A\ and (0, j 0 ), (1, ji),..., {d,j d ) 
be the sequence of labels of vertex where G(A , x) and G(A, y) differ. Then chan¬ 
nel ||x|| £ Fromc{jd, d + 1) and channel j d G Toc(\\x\\,d + 1). 

Proof. Refer to Parberry 0- □ 


4 New Theory for Pruning Last Four Levels 

We present a our new algorithm to construct the from, to and reach sets which 
is at least as good as Parberry’s algorithm. Meaning, if Parberry’s method 
rejects a network candidate then so does ours but the converse is not true in 
the general case. Hence, we are able to reject more candidates than Parberry’s 
method. 

Also, we present and prove upper bounds for the sizes of the from, to and 
reach sets for the third and fourth last levels which allow us to further reduce the 
search space significantly in comparison to Parberry’s and Bundala’s methods 
as all existing algorithms considers all possible network level candidates for the 
third and fourth last levels. 

4.1 Constructing the From , To and Reach Sets 

Our aim is to find methods of constructing the Fromc , Toe and Reachc sets 
of any comparator network C that would be superior to that of Parberry’s. The 
following results gives us a way to practically solve this task by find elements in 
the Fromc, Toe and Reachc sets of any comparator network C by considering 
only the output set representation Sc of C. 

Lemma 4.1. Let C be comparator network. Let x,y £ Sc be such that they 
differ in exactly one dimension. Then there exist inputs v,w £ I n which differ 
in exactly one dimension such that Vc{v) = x and Vc{w) = y. 

Proof. The result follows by induction on the depth d of C. 

Base: d = 0. Then Lemma H~T1 holds for w = x and w' = y. 

Assumption: Lemma Hill holds for all C of depth smaller then d. 
Induction Step: Let C = (Li,L 2 ,..., L d ~ 1 , L d ). There are three cases to 
consider. 

Case 1. {i,k),(k,i) ^ L d for 1 < k < n. Follows from assumption 
because the value of channel i at level cZ — 1 is unchanged at level d for any 
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input, in particular w and w'. 

Case 2. (k, i) G Ld■ Then v x (d— 1, k ) = 0 and v x (d— 1, *) = 0 because 
v x (d, i) = 0. Let s = (..., x*, = 1,..., x» = 0,...) and t =(..., x k = 0,..., Xi = 
0 ,...) be such that after applying Ld to s and t we get v and v' respectively. 
Using the assumption we apply Lemma l4~Tl to s, t and (L i,..., Ld- 1 ) to get the 
desired result. 

Case 2. (i, k) G Ld . Then v y (d — 1 , k) = 1 and v y (d — 1 , i) = 1 because 
v y (d, i ) = 1. Proof is analogous to Case 2 by setting t = (..., x*, = 1,..., Xj = 

1 ,...). 

□ 

Theorem 4.2. Let A and B be comparator networks such that C = A © B is 
a sorting network. Let d = \A\ and x,y G Sa differ only in the i-th dimension, 
where x =(..., a* = 1,...) and y = (..., a* = 0,...). Then ||x|| G Toc(i, d+ 1) 
and i G Frornc(||a ;||>d + 1). 

Proof. We apply Lemma 14.11 to x and y to find inputs v,w G I n which differ 
in exactly one dimension such that Vc(v) = x and Vc{w ) = y. Applying 
Lemma lTIDI to v and w yields that ||x|| G Toc(i, d+1) and i G Fromc(\\x\\,d + 
1 ). ' □ 

Assume that we are given the output set Sa of any comparator network A. 
The above Theorem ld. 21 gives us a way to construct the sets from, to and reach 
which must be contained in From.A@Bi Toa^b and Reach a ©b sets respectively 
for any comparator network B such that A © B is a sorting network by only 
considering outputs Sa that differ in exactly one dimension. The pseudo code 
for constructing the from, to and reach sets is presented in Algorithm [2J the 
correctness of which is given by Theorem 14.21 

4.2 Second Last Level 

We know that if we are given an output set Sa of any comparator network A we 
can construct the minimal from, to and reach sets for extending A to a sorting 
network. Using the cardinality upper bounds for any comparator network from 
Lemma 13. 191 we can devise a safety check for whether A can be extended to a 
sorting network with the addition of two levels. Hence, we can find all network 
levels candidates for the second last level when trying to extend the network 
A to an n-input sorting network by adding two levels. The pseudo code for 
finding the second last level candidates given an the output set Sa is presented 
in Algorithm [3] 

4.3 The Third Last Level 

The next lemma extends the theory of checking whether a comparator network 
can be sorted with the addition of two levels. We give an upper bounds on the 
sizes of the Toe and Fromc sets for the last three levels of any comparator 
network C at any channel. Using these bounds we design a safety check to 
reject comparator networks that are not be extendible to sorting networks with 
the addition of three levels, similar to the Method presented in the previous 
section 14.21 








Lemma 4.3. Let C be an n-input sorting network of depth d > 2. Then for 
any channel c the following hold \Toc{c , d — 3)|< 8, | Fromc{c, d — 3)|< 8. 

Proof. Follows immediately from the proof of Lemma 13.171 by considering all 
possibilities when we add an extra level. □ 

4.4 The Look-Ahead 

Out next result — referred to as “The Look-Ahead” — tells us that if we try 
extend the comparator network A by exactly one level then the size of the set 
of distinct from sets of any channel c is at most n. In other words, if we extend 
A by one level then the from set of a channel c is the same for all levels that 
contain the comparator |c, q\ for a fixed channel q. Meaning that if the level L 
that we extend A by contains the channel (c, q) then the other comparators of 
this level have no effect on the from set at channel c, and channel q. 

Lemma 4.4. Let A and B be n-input comparator networks, where the depth of 
A is d. Let L and L' be levels such that for a fixed channel c we have {q | (c, q) £ 
L d } = {q' | ( c,q') £ L d '}. Then Form A ®L®B(c.d- 1-1) = From A ® L > eB (c,d + 1). 

Proof. Follows immediately from Definition 13.161 □ 

Lemma m allows us to reject any forth last network level candidate that 
contains a comparator (p, q) for which |/7'om(p)| > 8 or \from(q)\ > 8 for the 
comparator network A0{(p, q)}, where the from sets are computed as described 
in section im The pseudo for pruning networks that cannot be extended to 
sorting ones by the addition of four levels is presented in Algorithm [5] 

Using Lemma 14.41 we can derive similar argument for the look-ahead at level 
two by checking \from(p)\ > 4 or \from(q)\ > 4 for any comparator (p, q) that 
is part of the third last layer. Although, we do not present pseudo code for this 
method (trivial task) we have encoded it in the implementation of the algorithm 
presented in section [5] 

5 Algorithm for Finding n-input Sorting Net¬ 
works of Minimal Depth 

The pseudo code of the algorithm for checking whether an n-input sorting net¬ 
work of depth d exists is presented in Algorithm |T] Altogether, it is a direct 
implementation of the theory presented in section [I] together with the highly 
efficient algorithm [7] for finding minimal representative itemsets up to permu¬ 
tation and reflection. The algorithm computes the output sets that are minimal 
representative up to permutation and reflection at each level t, R n .t ■ If d—t < 4, 
we remove elements from this set if they cannot be extended to sorting networks 
with the addition of d—t levels using the already described safety pruning checks 
from section [U 

5.1 Algorithm Correctness 

In this section we give a few results that are used to prove the correctness of 
Algorithm [T] which is given in terms of comments in the pseudo code that point 
to proven theoretical results. 
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Definition 13.61 gives us a map M : C i—>■ Sc from a comparator network, 
defined as levels of comparators, as per Definition 13.11 to an output set. M 
is not injective, which implies that the number of output sets of comparator 
networks of depth d is bounded above by the number of comparator networks 
of depth d. As our goal is to find minimal depth n-input sorting networks it 
is important to present a method for checking if a comparator network C is a 
sorting network by only considering its output set Sc- 

Theorem 5.1. An n-input comparator network C is a sorting network iff\Sc\ = 

n + 1 . 

Proof. If C is a sorting network then Sc must be equal to T n because every 
input is sorted by C, hence |S'c| = n + 1. It is obvious that T n C Sc because 
Veit) = t for any t £ T n . If (ScI = n + 1 then we know that Sc = T n because 
\T n \ = n + l and T n C Sc, hence C is a sorting network. □ 

Looking at Algorithm Q] given the set R n ,d we need to be able to answer 
the question of whether there exists an n-input sorting network of depth d. 
As discussed, we can apply Theorem 15.II to every element in the set of output 
sets R n .d but the following lemma gives us a more practically useful result, i.e. 
computationally cheaper to check. 

Lemma 5.2. Suppose that there exists an n-input sorting network of depth d 
then — 1. 

Proof. Let C be an n-input sorting network of depth d and let B be an n- 
input comparator network. Since R n ,d contains the minimal representative up 
to permutation and reflection outputs of itemsets and T n £ R n ,d, we have 
Sc = Tn- Since T n C S B , then Sc C S B - Therefore R n , d = {Sc} = {T n }, 
hence \R n ,d\= 1- □ 


6 Empirical Evaluation 

Clearly, in terms of the presented algorithm, the optimal depth of an n-input 
sorting network is the smallest d for which Exists-Sorting-Network(n, d) returns 
true. Now we move onto the experimental evaluation of this algorithm and 
compare it to the current state of the art approach. 

6.1 Environment Setup 

In all of the conducted experiments we used a computer with four Intel Xeon 
CPU E7- 4820 processors. Each CPU has 8 cores clocked at 2.00GHz, equipped 
with 8MB of third level cache and 128GB of main memory. 

We have summarized a subset of the conducted experiments in Figure [1] We 
will now describe in detail how to interpret the data presented in this table by 
focusing on the row for n = 11. All other rows can be interpreted in the same 
logical manner. The value for |7? n ,3| is the total number of networks of depth 
three that are a complete set of filters [T. To everyone of these itemsets our 
algorithm tries to apply every level from G n and the look-ahead pruning check 
manages to reduce this number from |i? ni 3 | * \G n \ = 361 564 784 to 105 290 955 
itemsets that could be sortable in three levels. We then find the itemsets that 
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can be sortable in three levels by applying Lemma H~51 to find that only 866 314 
networks could be extended to sorting ones with the addition of three levels. 
Similarly, our algorithm then applies all network levels to the sortable in three 
level itemsets to find the networks that could be sortable in two levels; in this 
case no such networks exist. Since our pruning techniques are safe we can deduce 
that there does not exist an eleven-input sorting network of depth seven because 
there are no networks of depth five that could be extended to sorting ones with 
the addition of two levels. The total runtime of 311 seconds is in the same 
order of magnitude as the total runtime of 105 seconds (in []j[ Table 8 the sum 
of values for row n = 11 at columns “BEE” + “SAT”) that it took Bundala’s 
program to prove that there does not exist an eleven-input sorting network 
of depth seven; although, it is important to note that we have used different 
machines (architecture, RAM, CPU power, ...) and that no real conclusion 
could be drown from comparing these reported runtimes. 


n 


Third-Look-Ahead 

Sortable-In-Three 

Second-Look-Ahead 

Sortable-In-Two 

Runtime 

11 

10129 

105 290955 

866 314 

0 

0 

311 

12 

117517 

72 319 916 

7847 

0 

0 

210 


Figure 1: Experimental evaluation of Algorithm |T| for checking whether there 
exists a sorting network of depth seven for eleven and twelve inputs. The col¬ 
umn | R n 5 31 gives the number of minimal representative up to permutation and 
reflection outputs of comparator networks of depth three. The column Third- 
Look-Ahead presents the total number of output sets that could be sortable in 
three levels as per Algorithm [5] Sortable-In-Three is a reduction on the column 
Third-Look-Ahead without applying any levels as per Algorithm [4] Second- 
Look-Ahead gives the total number of output sets that could be sortable in 
two levels. Sortable-In-Two is the total number of output sets that are sortable 
in two levels as per Algorithm [3] The Runtime column presents the total ex¬ 
ecution time in seconds; i.e. if program is executed on two threads and the 
individual CPU time of each thread is 5 seconds then the total Runtime would 
be 10 seconds. 


7 Conclusion and Future Work 

In this paper, we have presented new pruning techniques for the last four levels 
of a sorting network. These techniques are superior to the ones presented by 
Parberry (developed only for last two levels). We do not compare our techniques 
to the ones presented by Codish [2] for the last layer because Codish’s methods 
are aimed at the SAT encoding of sorting networks where they consider less input 
information then what we do. We have also presented an algorithm for finding 
optimal depth sorting networks that makes use of the newly presented search 
space size pruning techniques. We have evaluated an implementation of this 
algorithm to prove (although not novel) the optimal depths of sorting networks 
for all n < 12. The runtimes of our program are comparable to those that 
are reported by Bundala’s [5] state of the art method, although since different 
machines are used this is to be interpreted as a guideline only. It is important 
to note that for n = 11 , our pruning techniques reduce the search space size by 
about 25% for the fourth level and by 100% (our pruning technique rejects all 
networks) for the fifth level when compared to Bundala’s approach. 
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Algorithm 1 Pseudo code for our new algorithm for finding minimal depth 
n-input sorting networks. The minimal depth of an n-input sorting network 
is the smallest d for which Exists-Sorting-Network(n, d) returns true. Proof of 
correctness of the presented functions is given by comments. 


1 

2 

3 

4 

5 

6 


7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 


function ExiSTS-SORTiNG-NETWORK(int n, int d) 

Co t— n-input comparator network of depth 0 

R[0\.insert(Sc o ) > R[i] is a set of output sets 

for depth = 1, 2,..., d do 

R[depth] <r- Generate-Next-Depth(i?[depf/i — 1], depth, d) 

R[depth .] «— Min-Sets-Up-To-Perm-Refl(/f [depf/i]) > Algorithm 1 in 
[7j for finding the minimal representative itemsets up to permutation and 
reflection. 

end for 

if |f?[t]|= 1 then > Lemma [5721 

if |£ii[t][0]l=ra + l then 

return true > Theorem 15.II 

end if 
end if 

return false 
end function 


function GENERATE-NEXT-DEPTH(set of output sets R, int n, int d, int t) 
result 0 > set of output sets 

for all Sc € R do 

Levels <— Get-All-Levels (Sc, ft, d, t) 

for all L G Levels do t> Definition 13.II 

result <— result (J {Sc©l} 

end for 
end for 

return result > result does not contain duplicates 

end function 


function Get- All-Levels (output set Sa, int n, int d, int t) 

result -<—0 > set of output sets 

if d + 4 = t then 

return Get-Fourth-Last-Levels(5 , A, n) 

end if 

if d + 3 = t then 

return Get-Third-Last-Levels(S , A, n) 

end if 

if d + 2 = t then 

return Get-Second-Last-Levels(5' J 4, n) 

end if 

return G n > The set of all levels. 

end function 
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Algorithm 2 Pseudo code for constructing the minimal from, to and reach 
sets for any sorting network A © B by using only the output set Sa- Proof 
of correctness is given by comments referring to theoretical results presented 
in this paper. The worst case time and space complexities for the function 
Get-From-To-Reach-Sets are 0(2 n n) and 0(2”) respectively. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 


function GET-FROM-To-REACH-SETs(output set Sa) 
for channel c = 1.. . n do 

to[c] t— 0 > to[c\ is a set of channels 

from[c] -<—0 > from[c\ is a set of channels 

reach[c] -<—0 > reach[c] is a set of channels 

end for 

for all outputs x,y £ Sa do 

if Get-Different-Coordinates-Count(a;, y) == 1 then 
c <— Get-First-Different-Coordinate (a, 1 , y) 

H\x\\ i — to[\x\\ U {c} 
reoc/i[|x|] <— reac/i[|x|] (J {c} 
from[c\ <— from[c\ (J {|x|} 
reach{c\ <— reach{c\ (J {|x|} 
end if 
end for 

return (from, to, reach) 

end function 

function GET-DiFFERENT-CoORDiNATES-CoUNT(output x, output y) 
count i — 0 

for channel c = 1... n do 
if x[i] yf y[i\ then 

count <— count + 1 

end if 
end for 
return count 
end function 

function GET-FiRST-DiFFERENT-CoORDiNATE(output x, output y) 
for channel c = 1... n do 
if x[c\ yf y[c] then 
return c 
end if 
end for 

return 0 > Invalid result 

end function 






Algorithm 3 Pseudo code for finding all network level candidates for the second 
last level of the comparator network A represented by the output set Sa- The 
worst case time and space complexities for the function Get-Second-Last-Levels 
are 0(2 n mn) and 0(2 n ) respectively. Correctness of the pseudo code is given 
by comments referring to results shown in this paper. 

1: function GET-SECOND-LAST-LEVELS(output set Sa, int n) 

2 : levels i — 0 

3: for all L £ G n do 

4: if Sortable-In-Two-Levels {Sa®l) then 

5: return levels < — levels (J {L} 

6: end if 

7: end for 

8 : return levels 

9: end function 

10 : 

11: function SORTABLE-lN-TwO-LEVELS(output set Sa) 

12 : {from, to, reach) < — Get-From-To-Reach-Sets(SU©i,) 

13: for channel c = 1... ?x do 

14: if |/rorn[c]|> 4 or |to[c]|> 4 or \reach[c\\> 5 then 

15: return false 

16: end if 

17: end for 

18: return true 

19: end function 
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Algorithm 4 Pseudo code for finding all network level candidates for the third 
last level of the comparator network A represented by the output set Sa- The 
worst case time and space complexities for the function Get-Third-Last-Levels 
are 0(2 n mn) and 0(2”) respectively. Correctness of the pseudo code is given 
by comments referring to results shown in this paper, 
t: function GET-TfflRD-LAST-LEVELs(output set Sa, hit n ) 

2 : levels i — 0 

3: for all L £ G n do 

4: if Sortable-In-Three-Levels(5' J 4®L) then 

5: return levels i — levels U {L} 

6: end if 

7: end for 

8: return levels 

9: end function 

10 : 

11: function SORTABLE-lN-THREE-LEVELS(output set Sa) 

12 : {from, to, reach) <— Get-From-To-Reach-Sets(SU©L) 

13: for channel c = 1 ... ?x do 

14: if |/rom[c]|> 8 or |fo[c]|> 8 then 

15: return false 

16: end if 

17: end for 

18: return true 

19: end function 


Algorithm 5 Pseudo code for finding all network level candidates for the fourth 
last level of the comparator network A represented by the output set Sa, also 
referred to as the “Look-Ahead”. The worst case time and space complexities 
for the function Get-Fourth-Last-Levels are 0(2 n mn) and 0(2 n ) respectively. 
Correctness of the pseudo code is given by comments referring to results shown 
in this paper. 

1 : function GET-FouRTH-LAST-LEVELS(output set Sa, mt n) 

2 : comps < — 0 

3: for all comparators {a, b) do 

4: Li —{(a,&)} 

5: {from, to, reach) < — Get-From-To-Reach-Sets^^©^) 

6: if |/?’o?n[a]|> 8 or \ from[b]\> 8 then > “Look-Ahead” 

7: comps < — comps U {(a,b)} 

8: end if 

9: end for 

10: return {L G G n \ Vc G L : c£ comps} 

11: end function 
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